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ABSTRACT 


This  is  the  Final  Report  for  a research  grant  whose  objective 
was  the  development  of  efficient  computer  techniques  for  the 
processing  of  line-drawing  images.  A variety  of  specific  problems 
were  investigated.  These  included  improved  coding  techniques  for 
cartographic  data,  the  reconstruction  of  solid-object  descriptions 
from  multiple- image  projections  of  the  objects,  the  removal  of 
hidden  lines  from  projections  of  both  planar-faced  and  curved- 
surface  objects,  the  design  of  a line-drawing  analysis  language 
called  CHAP  and  the  development  of  a scheme  for  line-pattern 
classification. 
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1.  SUMMARY  OF  RESEARCH 

1.1  General 

This  is  the  Final  Report  for  Grant  AFOSR  76-2937  and  spans  the  period 
1 September  1975  through  31  August  1973.  Two  Interim  Technical  Reports* 
were  issued  during  the  grant  period,  one  in  October  1976  and  the  other  in 
October  1977.  In  addition  a total  of  13  regular  technical  reports  were 
issued  and  19  articles  were  published  in  the  technical  literature.  A 
complete  listing  of  these  items  is  given  in  Section  4 of  this  report. 

Some  of  the  items  have  not  yet  appeared  in  print  but  have  been  accepted 
for  publication. 

Since  the  two  Interim  Technical  Reports  contained  fairly  comprehensive 

summaries  of  the  respective  preceding  years,  this  report  will  summarize 

primarily  only  the  research  carried  out  during  the  last  year  of  the  grant, 

i.e.,  the  period  1 September  1977  - 31  August  1973.  During  this  period, 

the  emphasis  of  the  research  was  on  the  study  of  the  characteristics  of 
# 

the  so-called  generalized  chain  codes,  a new  family  of  codes  for  representing 
cartographic  and  similar  line-drawing  type  data.  Work  continued  also  on 
the  debugging  and  refinement  of  CHAP,  a computer  language  for  line-drawing 
analysis.  Other  work  was  concerned  with  the  representation  and  classifica- 
tion of  shape,  and  with  the  description  of  three-dimensional  scenes  using 
data  extracted  from  multiple  images  of  the  scene. 

♦"Automatic  Data  Processing  Techniques  for  Graphic-Data  Display,  Generation 
and  Analysis",  Interim  Technical  Report  for  Grant  AFOSR  76-2937,  CRL-50, 

1 September  1975  - 31  August  1976,  (AD-A033  315). 

"Automatic  Data  Processing  Techniques  for  Graphic-Data  Display,  Generation 
and  Analysis",  Interim  Technical  Report  for  Grant  AFOSR  76-2937, 

1 September  1976  - 31  August  1977,  ( AD-A049  317). 
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1.2  The  Generalized  Chain  Coding  Scheme 

As  a result  of  earlier  research  under  this  grant,  it  was  discovered 
that  the  familiar  basic  8-direction  chain  code  could  be  effectively  extended 
to  a family  of  general  chain  codes,  having  attractive  properties  relative 
to  compactness,  precision,  and  smoothness.  The  characteristics  of  the 
new  codes  was  examined  and  their  relative  advantages  were  described.  It 
was  discovered  that  for  certain  applications,  some  of  the  high-order  chain 
codes  (involving  many  more  than  the  8 directions  of  the  basic  code)  were 
extremely  advantageous  via  yielding  reduced  storage  requirements,  higher 
precision,  shorter  processing  times,  and  greater  smoothness  of  presentation. 
The  results  have  been  published  in  a number  of  articles  [26-29]. 

1.3  The  CHAP  Line-Drawing  Processing  Language 

For  a number  of  years,  algorithms  for  line-drawing  processing  had  been 
developed  and  programmed  by  the  principal  investigator  and  his  associates. 
These  were  collected  into  a single  programming  package  called  CHAP  to 
facilitate  their  use  in  the  project  as  well  as  for  making  them  available 
to  other  researchers.  The  first  version  of  CHAP  was  completed  over  a year 
ago.  During  the  past  year,  the  language  was  subjected  to  extensive  testing 
and  refinement,  some  additional  subroutines  were  added,  and  a number  of 
"bugs"  were  removed.  Also  a new  set  of  user's  and  documentation  manuals 
were  prepared  and  distributed  [24-25]. 


1.4  Representation  and  Classification  of  Shape 

An  investigation  started  during  the  previous  year  to  develop  an  im- 
proved shape  representation  and  classification  scheme  was  continued. 
Emphasis  was  placed  on  the  extraction  of  a variety  of  critical  points,  that 
is,  points  in  a shape  (such  as  corners,  inflection  points,  curvature 
maxima,  etc.)  that  could  be  uniquely  identified  and  at  which  a shape  could 
be  unambiguously  segmented.  The  technique  developed  proved  to  give  good 
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results  with  a large  variety  of  shaped  and  to  be  relatively  modest  in  its 
demands  on  computer  processing  time.  Shape  classification  is  important 
for  any  kind  of  matching  or  fitting  problem  as  well  as,  of  course,  for 
storing  and  retrieving  line-drawing  data  according  to  shape  [e.g.  finger- 
prints, cartographic  features)  [30 j. 

1.5  Modelling  Scenes  Using  Data  from  Multiple  Images 

Work  also  was  continued  during  the  past  year  on  a research  study  to 
develop  effective  techniques  for  constructing  computer  models  of  three- 
dimensional  objects  from  data  extracted  from  multiple  images  of  the  object 
Few  if  any  limitations  were  put  on  the  geometry  of  the  objects  considered 
they  could  be  planar-faced,  quadric-curved,  or  free-form  curved.  Efforts 
were  concentrated  on  methods  for  creating  such  computer  models  in  spite 
of  serious  imperfections  in  the  source  data.  The  source  images  could  be 
low  resolution  and  contain  distortion,  glare,  haze  and  shadows.  Papers 
describing  the  work  were  published  during  the  past  year  [22,  31],  or  are 
to  appear  shortly  [34]. 


2.  ABSTRACTS  OF  RECENT  PUBLICATIONS 


2.1  H.  Freeman,  "Analysis  of  Line  Drawings",  in  Digital  Processing  and  AnaWsis, 
ed.  by  J.  C.  Simon  and  A.  Rosenfeld,  Noordhoff,  Leyden,  1977.  * 

Abstract:  This  paper  is  concerned  with  the  computer  analysis  of  line 

drawings.  Line  drawings  serve  as  a medium  for  communication  in  a 

* large  variety  of  fields,  and  the  processing  to  which  they  may  be 

subjected  is  very  much  dependent  on  the  application  of  interesc. 

The  paper  discusses  different  types  and  features  of  line  drawing, 

and  reviews  the  more  important  schemes  for  quantizing  and  encoding 

them.  Algorithms  for  analyzing  line  drawings  are  described,  with 

particular  emphasis  on  extracting  geometric  and  shape-related 

features. 


2.2  Keith  P.  t.oepere,  "CHAP  User’s  Manual",  Technical  Report  CRL-56, 
Rensselaer  Polytechnic  Institute,  Troy,  New  York  12131,  May  1978, 
56  p. 

Abstract:  A computer  representation  for  line  drawings  that  has 
been  found  particularly  convenient  and  has  become  widely  accepted 
is  the  chain  code.  This  representation  is  compact  and  allows  most 
common  processing  functions  to  be  performed  efficiently. 

CHAP  is  a collection  of  FORTRAN  routines  designed  to 
process  chain-encoded  line  drawings.  Routines  exist  in  CHAP 
to  manipulate,  synthesize,  analyze,  and  do  input  and  output  upon 
chains.  This  report  is  intended  to  serve  as  a user's  manual  for 
CHAP.  It  describes  the  use  of  the  CHAP  routines  along  with  other 
information  needed  to  write  a program  utilizing  the  routines.  A 
programming  example  is  included. 


2.3  Keith  Loepere,  "Documentation  Manual  for  CHAP",  Technical  Report 
CRL-57,  Rensselaer  Polytechnic  Institute,  Troy,  New  York  12131, 
May  1978,  52  p. 

Abstract:  This  is  a documentation  manual  for  the  CHAP  chain 
processing  language.  CHAP  is  a collection  of  routines 
developed  for  analyzing,  synthesizing,  and  manipulating 
chain-encoded  line  drawings.  This  report  describes  the  internal 
operation  of  the  CHAP  routines.  It  is  a companion  volume  to 
the  CHAP  User's  Manual. 
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2.4  Herbert  Freeman,  "The  Generalized  Chain  Code  for  Map  Data  Encoding 
and  Processing",  Technical  Report  CRL-59,  Rensselaer  Polytechnic 
Institute,  Troy,  New  York  12181,  June  1978,  29  p. 

Abstract:  The  concept  of  chain  coding  for  map  data  based  on  the 

well-known  8-direction  coding  matrix  is  generalized  to  coding 

schemes  involving  16,  24,  32,  48  and  even  more  permissible 
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directions  for  the  line  segment  links  in  the  chain  representation. 
General  methods  for  quantization  and  encoding  are  described.  The 
different  schemes  are  compared  with  respect  to  compactness, 
precision,  smoothness,  simplicity  of  encoding,  and  facility  for 
processing.  The  resulting  coding  schemes  appear  to  have 
desirable  characteristics  for  map  data  processing  applications 
because  of  their  improved  storage  efficiency,  smoothness,  and 
reduced  processing  time  requirements. 
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2.5  Herbert  Freeman,  "Application  of  the  Generalized  Chain  Coding 
Scheme  to  Map  Data  Processing",  Proc.  1973  Conference  on  Pattern 
Recognition  and  Image  Processing,  pub! . 73CH1318-5C,  IEEE  Computer 
Society,  5855  Naples  Plaza,  Suite  301,  Lona  Beach,  CA.  90803,  June 
1973,  pp.  220-226. 

Abstract:  The  concept  of  chain  cuding  based  on  the  well  known 
3-direction  coding  matrix  is  generalized  to  coding  schemes  in- 
volving 16,  24,  32,  48  and  even  more  permissible  directions  for 
the  line  segment  links  in  the  chain  representation.  General 
methods  for  quantization  and  encoding  are  described.  The  different 
schemes  are  compared  with  respect  to  compactness,  precision, 
smoothness,  simplicity  of  encoding,  and  facility  for  processing. 

The  resulting  coding  schemes  appear  to  have  desirable  characteristics 
for  map  data  processing  applications  because  of  improved  storage 
efficiency,  smoothness,  and  reduced  processing  time  requirements. 
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2.6  Herbert  Freeman,  "Some  New  Map  Data  Encoding  Schemes",  Proc.  3rd 
Jerusalem  Conference  on  Information  Technology,  North-Holi  and  Publ., 
Amsterdam,  August  1978. 

Abstract:  Some  new  schemes  for  encoding  map  data  are  introduced. 

The  schemes  can  be  regarded  as  generalizations  of  the  well  known 
8-direction  chain  coding  scheme.  Instead  of  being  limited  to  8 
types  of  links  for  approximating  a curve,  the  new  schemes  possess 
16,  24,  32,  48,  or  even  more  link  types.  The  new  schemes  permit 
increased  smoothness  of  representation,  exhibit  greater  precision, 
and  require  less  processing  time  for  comparable  resolution  than 
present  methods. 


2.7  H.  Freeman  and  A.  Saghri,  "Generalized  Chain  Codes  for  Planar 

Curves",  to  be  presented  at  the  4th  International  Joint  Conference 
on  Pattern  Recognition,  Kyoto,  Japan,  November  7-10,  1973. 

Abstract:  This  paper  describes  a set  of  line-segment-approximation 

codes  for  the  representation  of  planar  curves.  The  codes,  which 

represent  generalizations  of  the  common  8-direction  chain  code  to 

16,  24,  32,  43  and  even  more  valid  directions,  have  improved 

characteristics  in  terms  of  compactness,  precision,  smoothness  and 

processing  efficiency.  The  paper  describes  the  quantization 

procedures  for  these  generalized  chain  codes,  relates  their 

efficacy  to  the  radii -of-curvature  spectra  of  the  curves  to  be 

represented,  and  develops  criteria  for  the  selection  of  the 

appropriate  code  and  grid  spacing. 


2.3  Herbert  Freeman,  "Shape  Descriptions  via  the  Use  of  Critical  Points", 
Pattern  Recognition,  Vol.  10,  1978,  pp.  159-166. 

Abstract:  A key  element  in  pattern  recognition  is  the  description  of 
shape.  For  two-dimensional  objects  (blobs),  shape  is  conveyed  by  the 
curving  of  the  boundary  line  and  is  normally  considered  independent 
of  scale  and  orientation.  The  curving  may  be  regarded  as  concatenation 
of  arcs  of  varying  instantaneous  radii  of  curvature,  possibly 
interspersed  occasionally  by  discontinuities.  The  description 
of  shape  is  facilitated  by  segmenting  the  boundary  line  at  so-called 
critical  points  - corners  (discontinuities  in  curvature),  points  of 
inflection,  and  curvature  maxima.  Additional  critical  points  are 
intersections  and  points  of  tangency.  Algorithms  are  described  for 
extracting  such  critical  points  in  the  presence  of  noise.  An 
illustration  is  given  showing  how  the  critical  points  may  be  used 
in  the  development  of  a shape  description  system. 
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2.9  R.  Shapira  and  H.  Freeman,  "Computer  Description  of  Bodies  Bounded 
by  Quadric  Surfaces  from  a Set  of  Imperfect  Projections",  IEEE 
Trans,  on  Computers,  Vol . C-27,  (9),  September  1978,  pp.  341-853. 

Abstract:  This  paper  describes  a computer  program  for  constructing 

a description  of  solid  bodies  from  a set  of  pictures  taken  from 

different  vantage  points.  The  bodies  are  assumed  to  be  bounded 

by  faces  which  are  planar  or  quadric,  and  to  have  vertices  formed 

by  exactly  three  faces.  It  is  assumed  that  a preprocessor  provides 

the  program  with  line  and  junction  information  which  it  has  extracted 

from  the  pictures.  The  preprocessor  is  expected  to  make  mistakes, 

such  as  losing  features  or  providing  misinformation  about  their 

nature.  A technique  is  presented  for  validating  doubtful  features 

as  well  as  for  matching  corresponding  features  extracted  from  the 

different  pictures.  New  grammar  rules  are  developed  for  line-drawing 

projections  of  curved  and  planar  bodies  and  are  used  as  a tool  in 

the  scene  analysis  process.  Each  picture's  data  analysis  is  supported 

dynamically  by  the  results  obtained  thus  far  in  the  other  pictures' 

analysis.  The  analyzed  data  from  all  pictures  are  grouped  into  sets, 

each  corresponding  to  a single  face  (flat  or  curved),  whose  nature  is 

also  determined.  The  sets  are  grouped  again  to  correspond  to  the 

different  bodies  in  the  scene.  The  program  written  in  PL/I  has  been 

tested  successfully  on  several  scenes. 
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2.10  Herbert  Freeman,  "Algorithm  for  Generating  a Digital  Straight  Line 

on  a Triangular  Grid",  accepted  for  publication  in  IEEE  Trans.  Computers , 


Abstract:  An  algorithm  is  presented  for  generating  the  optimum 
straight-line  approximation  for  a plotter  constrained  to  move  a 
unit  distance  at  a time  in  one  of  six  equi-spaced  directions.  The 
algorithm  facilitates  the  drawing  of  digital  straight  lines  on  a 
triangular  grid. 


2.11  J.  Feder,  "Plex  Languages",  Information  Sciences,  (3),  1971, 
pp.  225-241,  (AD-A049  400). 


Abstract:  The  phase-structure  grammar  scheme  used  for  specifying 
string  languages  is  extended  to  structures  called  pi  exes  composed 
of  symbols  with  an  arbitrary  number  of  "attaching  points". 

Classes  of  plex  languages  that  parallel  existing  classes  of  string 
languages  are  defined,  and  these  classes  are  shown  to  be  distinct. 
Context-free  gramnars  for  languages  of  chemical  structures,  logic 
diagrams,  electrical  circuits,  and  flowcharts  are  given.  Plex 
languages  are  used  to  specify  the  interconnection  of  encoded 
geometric  curves  to  form  mesh-like  line  patterns,  and  methods 
are  given  by  which  languages  of  such  line  patterns  can  be 
classified. 
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3.  PRESENTATIONS 
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3.1  Herbert  Freeman,  "On  the  Template  Layout  Problem",  Department  of 
Computer  Science  Colloquium,  University  of  North  Carolina,  Chapel  Hill, 
N.  C. , 31  October  1977. 

3.2  , "Computer  Scene  Analysis",  Department  of  Electrical 

Engineering  Colloquium,  McGill  University,  Montreal,  Canada,  20  December 
1977. 

1 3.3  , "Efficient  Line  Drawing  Representation  through  the 

Use  of  Generalized  Chain  Code",  Engineering  Foundation  Conference  on 
Algorithms  for  Image  and  Scene  Analysis,  Asilomar,  California,  19-24 
February  1973. 

3.4  , "Research  in  Computer  Graphics  and  Scene  Analysis", 

Computer  Center  Seminar,  University  of  Calabria,  Italy,  22  March  1973. 

3.5  , "Shape  Characterization  by  the  Method  of  Roving  Line- 

Segment  Scanning",  IEEE  Computer  Workshop  on  Pattern  Recognition  and 
Artificial  Intelligence,  Princeton,  N.  J.,  12-14  April  1973. 

3.6  , "Lines,  Curves,  and  the  Representation  of  Shape, 

Computer  Science  Summer  Institute,  Lecce,  Italy,  14-15  July  1978. 
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